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ABSTRACT 

A process of developing and testing an instructional 
methodology called interactive radio instruction (IRl) was begun in 
1986 in order to improve the quality of primary school mathematics in 
Bolivia* When the development phase was complete and implementation 
well under way, management of the resultant Radio Learning Project 
(RLP) passed from the non-governmental organization (NGO) , Fe y 
Alegria, to the Ministry of Education and Culture (MEC) * Today, seven 
years after the initial pilot, approximately 600,000 primary-school 
children have enrolled in the RLP, renamed PARI; more than 8,000 
teachers have been trained and certified in the IRI methodology, and 
in 1992, Radio Math achieved national recognition as the "official" 
mathematics program of Bolivia. This case study assesses how NGO 
management sustained RLP continuity, describes how broad-based 
teacher support laid the base for institutionalization, and looks at 
how IRI has revolutionized education in Bolivia. Rather than dwell on 
issues related to methodology or impact, the study assesses the 
sustainabili ty of PARI from the sociological perspective, focusing on 
the issues of participation of people and systems key in driving 
national diffusion and sustainability. An appendix provides a 
chronology of events. (Contains nine references.) (Author/MAS) 
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Oz^erviezv 

In 1986, Fe y Alegria (FyA), a Bolivian non-go vernn^ental organization 
(NGO) sponsored by the Catholic Church, began the process of 
developing and testing a powerful instructional methodology called 
"interactive radio instruction" (IRI) to improve the quality of primary 
school mathematics. Throughout the following year, feasibility 
studies, needs assessments, and pilot implementation activities 
challenged the appropriateness of the intervention and Fe y Alegria's 
role as the lead institution in a country-wide initiative. Would it work 
in Bolivia? Would the teachers and students like it? The dramatic 
improvement in student learning produced by the initial pilot, 
however, confirmed both children's readiness to "takeoff" with the 
radio instruction and FyA's intellectual and institutional capability of 
continuing management at the national le\ el. 

Four hundred and fifty second-grade students participated in the 
initial Radio Learning Project (RLP) mathematics pilot. By 1991, the 
complete set of 540 lessons for grades 2-5 had been validated and the 
Ministry of Education and Culture (MFC) was considering expanding 
access to all schools. With the development phase complete and 
implementation well underway , management of Bolivia's Interactive 
Radio Learning Program (PARI, the new project's name) passed from 
FyA to the MFC; and in 1992, PARI began validating a new IRl-based 
preventive health curriculum for upper-primary school. Today, seven 
vears after FvA's initial pilot, approximately 600,000 primary-school 
children haveenrolled in RLP/PARl; more than 8,000 teachers have 




Enrollment 
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Learning 
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PARI has 
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been trained and certified in the IRI methodology, and in 1992, Radio 
Math achieved national recognition ab ''the official" mathematics 
program of Bolivia. 

Its decentralized evolution has set this project apart from most other 
education projects around the world. This case study assesses how 
NGO management sustained RLP continuity, it describes how broad- 
based teacher support laid the base for institutionalization, and looks 
at how IRI has revolutionized education in Bolivia. Rather than dwell 
on issues related to methodology or impact, the study will assess the 
sustainabilitv of PARI from the sociological perspecti\'e, focusing on 
th e issues of participation of people and systems key in driving 
national diffusion and sustainabilitv. 

Seeds of a Pro ject: Responding to the Needs of a Nation 

In 1985, Bolivia's primary education system was in a state of crisis, 
and the national economy was on the verge of collapse. Just 32 of 
every 100 students who began first grade completed fifth grade, and 
student repetition rates were pegged at 30%. Hyperinflation had 
firmly established itself at 24,000"n, severely limiting government's 
ability to respond to the public demand for quality education. Because 
the MEC could not maintain teachers salaries at even minimal 
standards, educational opportunities declined. The resulting shortfall 
of trained teachers, absence of textbooks and other instructional aids, 
and exaggerated teacher absenteeism provoked a profound loss of 
confidence in public education. 

A 1987 study of primary-school desertion conducted by the Bolivian 
Center for Educational Research and Action (CEBIAE) noted an 
alarming decrease in the number of children matriculated between 
1976 and 1984. It concluded that not only was the economic crisis 
influencing parents' decisions to send or not send their children to 
school, it was also a decisi\'e factor in teacher abandonment. Other 
factors affecting drop-out reflected the poor quality of instruction, and 
the lack of relevance in programming. During this period, students 
lost upwards of a month of instruction out of e\'erv school year to 
teachers' strikes; and on the days that school was in session, many 
students were inattentive, unattended, or treated as the object rather 
than the subject of education. 

In l^)8f\ Bolivia adopted a far-reaching economic plan aimed at 
restoring priceslability and restructuring the economy. Reform oi 
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Bolivia's weakened ediication system, however, lagged behind. 
Teachers' skills needed to be upgraded, the curriculum needed to be 
revised, theadministrative/supervisory system needed to be 
restructured, and infrastructure needed to be improved. In other 
words, what took a decade to destroy would take generations to 
rebuild; and public dissatisfaction with existing services was high. 

The inefficiency of the public -school system fueled movement in 
Bolivia's urban centers towards private, fee-paying schools. At the 
same time, parallel movement in peripheral areas supported the 
decentralization of education, or the private administration 
of public schools by non-go\'ernmental organizations. Such 
organizations generally operated through ministerial agreements 
under which the NGO administered the school and the Government 
paid the teachers' salaries. The participation of NGOs in formal 
education was limited almost exclusively to the Catholic Church, 
which represented about 13 percent of all enrolled children. (The 
World Bank 1993). The Radio Math pilot project chose to follow these 
new trends in decentralization and to rely on an NGO to improve 
public education. 

Fe y Alegrias 
efforts focus 
on teachers' 
skills^ 

student needs 
and parental 
participation. 



Decentralization and Fe y Ale^ria 

Fe y Alegrla is the largest of the Cnthoiic NC^Os. Their mission is to 
extend edu( dtional (opportunities to underserved communities in 
Bolivia. Throughout their nearly 30 years of service, HyA has 
demonstrated an excellent capacity as an institution to efficiently 
administer c\ complex network o\ schools and provide in-service 
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support for teachers. In 1986, FyA directed 195 public education 
centers with more than 78,000 students and 3,100 teachers. 
Enrollment in their schools is free and open to all students. FyA 
efforts focus on improving teachers' skills, making schooling more 
relevant to individual needs, increasing parental participation in the 
educational process, and raising the o\'erall level of social 
consciousness within the community. Located primarily in the poorer 
suburban and rural areas, each center uses the official curriculum as a 
basis for instruction; however their programmatic orientations differ 
(production, scholastic, vocational, etc.) according to the needs and 
expectations of the communities they serve. FyA outreach also 
extends beyond the formal school en\'ironment and includes the 
oldest and largest adult literac)- program in the country — IRFA 
(Radiofonic Instruction, Fe y Alegria). 

In 1986, the Episcopal Education Commission (CEE), the coordinating 
committee for the Catholic NGOs, requested USAID/Bolivia 
assistance to assess the potential of using IRl to improve primary- 
school mathematics instruction. They were moti\'ated by the need to 
establish an immediate quality input that could be easily managed 
until the MEC had a more rigorous instructional system in place. 



While the initial feasibility study confirmed the viability of using IRl 
in tiie schools, it cautioned against taxing the MEC with the 
additional burdenofprojectmanagement. Instead, it recommended 
that an NCC^ manage thede\ elopmental phase ol the project. The 
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feasibility study also suggested that a pilot be undertaken to: 1 ) verify 
that Bolivian school children can learn significantly more from the 
radio-based methodology than by traditional instruction; 2) evaluate 
whether the radio mathematics curriculum and lessons originally 
developed by previous IRl projects in Central America might be 
appropriate for adaptation in Bolivia; 3) evaluate whether Bolivian 
teachers would be able to use the interactive-radio programs 
effectively with a minimal amountof training or supervision; and 4) 
assess local capability to implement the project institutionally, 
administratively, and technically. 

"...r(v zccrc uot cutirchj clear about what was rcalhj involved. The 
pilot provided F\/A au opportunity to test IRl..." 

R. P. Victor Blajot, Director, Radio Santa Cruz, 

FyA 

Although Fe v Alegria schools operate more efficiently than do other 
public schools, thev too were concerned about the quality and le\'el of 
instruction in core subjects like mathematics and language. This 
prompted them to join together with EDC to pilot-test the Radio 
Mathematics methodology and lay the foundation for Radio Learning 
Project. 

Early Results: Stiidcuts, Teachers and Parents 
Respond 

"\ (Pf7s cofieenied about the qualit}f a)ui })iorale of the professors so 
I was ope}i to^oui^ ahead xcith the pilot. I saw a sohitio)! to a 
problem." 

H. Maria Otaegui, FyA Director Santa Cru/ 

In 1987, Bolivia became the first country in South America to use IRI, 
Between April and July of that year, the FyA staff adapted, produced, 
and broadcast the first 20 lessons of the second-grade curriculum. A 
total of 4^0 students and 1 1 teachers in the cities of Santa Cru/ and 
Cochabamba participated in the pilot. Gains in student mastery of 
basic concepts taught by the radio were measured through pretests 
and posttcsts in all participating schools. Student/teacher interaction 
with the instructional-radio program was evaluated through daily 
observations in participating classrooms. Teachers' impressions were 
gathered through written questionnaires and by focus-group 
interviews. I rom this we le.u'ned thai: 
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❖ Boli\ ion schoiil childivn cnn iMsily learn mc-itlu»matics bv 
i!itLM tU ti\ 0 i tui io. Teachers observed that the radio students 
seemed to be more alert and more actively involved in the 
learning process than were children in traditional classes. 
Other teachers commented that children's ability to think 
critically was heightened through the instructional-radio 
programs; and still others noted how IRl was contributing to 
the development of Spanish-language skills among bilingual 
students. Table 1 illustrates the dramatic gains in student 
mastery achiex'ed during the pilot. 

Hc^li\ ian >tudent^ entering; seccnid grade ha\ o the nec'os^arx" 
p! erequi>ite ^kill> in numeration, addilitm, and simple 

ibtrac ticMi to "take-ott" with the radio lessons. No 
modification of the first grade curriculum would be needed to 
prepare the students for the radio intervention. 

<♦ lH>!i\ ian U\KiH'rst\in otk'cli\ ol\" use I lie interactixc-radit^ 
lesMMis with basil- trainin^i;. During a one-day orientation, 
teachers were familiarized with the classroom materials, radio 
lessons, testing instruments, and postb road cast activities. 
Throughout the pilot, teachers demonstrated a high degree of 
a'>mpetence when using the instructional radio programs. 

<* \ c \ Xk'gria had Ihe institutional ca[\u it\' to handle the 
h\ hn w a! ant.1 inanaj^enal aspt^x ls ot ihv pt oj^'ct \\ ith 
lontinoeci tev-hnical assistance. The administrative structure 
of Fv A prov ed strong enough to support initial project 
implementation actix'ities and act as a springboard for 
national dissemination within Bolivia. 

The results of the U)H7 Radio Mathematics pilot were extreme^lv 
enctuu'aging- 
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Teachers: A Key Element 

Not only did the radio intervention inspire chi Idren to learn more by 
actively invok ing them in the learning process, it also challenged 
teachers to break with the traditional form of insti action — rote 
learning. 

"For \/ciir>, the tCiuiicr^ were u^cd to u<i}}^ the blnckbonrd mid n 
/t'(7d/:T's \^uide that they )i.ade themselves. So couiinif in xeith d 
}iexv method that included a radio xeasfi 't easi/ for the teachers, 
studejits, school directors or supervisors to accept. Theparoits 
had a hard tiaie accepting it, too. " 

Professor Jorge Avala, National Coordinator, 

MEC 

Teachers 
interpreted 
the success 
of their 
students as 
their own 
success. 



The Boli\'ian pilot carefully focused attention on the role of the teacher 
in facilitating the radio class and in leading the post-broadcast 
session. According tt) Gabriel Codina, National Director of Fe y 
Alegria, 

"Not all of the teachers felt involved and counuitted to the 
pro\iraw<. The teachers xoho took a)! interest ui the pros^ram from 
the ven/ first used the iiexo methodolos^i/ well Tiny pros^res^cil 
aiul improved professioualh/ and persofiallu. Teaciters ivho 
applied the mcthodolos^i/ hi a rote auuuier or ivere reluctant to 
implement it, did ijot hoiefit per^ofialli/ or suhstautially improve 
their irai hin\^ ^-kill^. " 

Although many teachers entered into the pilt>t conu'rned that the 
radio could repKue them they generally finished bv embracing the 
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methodology, Thvy interpreted thesuccessof their students as their 
own success, and came to \ iew the radi(^ as an important tool for 
learning. Teachers wanted to continue with IRl and expand its 
application to science, language, and social studies. Long-held 
perceptions of teaching and learning were beginning to change. 

The enthusiasm of the students for Radio Math motivated parents to 
seek additional information about the program. Parents who had 
previously felt disenfranchised from the education system expressed 
hope. They were curious about vv'hat their children were doing. In 
one school on the road to Cochabamba, parents who had never 
stepped foot in the classroom before came to see what was happening 
with the radio. 

Other parents frequented their local radio station and FyA office to ask 
that the programs be made available to them as well. They wanted to 
learn along with their children. Radio Math also began to penetrate 
the populace in an unexpected way, even taxi drix ers and market 
vendors were beginning to tune in. 

".../ nlwni/^ hclicvcii in RLP/ PARI,.. .realized that the work wns 
valid. HouYVcr it wa^ not until I visited the schools and 
experienced the appreciation of the teachers, stndoits, and parents 
that I realized the potential was even greater than I had 
i}nai^i}}ed. " 

Lie. EmilioOros Mende/, RLP/PARl Executive 
\y\rvciar 

Throughout the pilot, the Radio Mathematics team observed the IRI 
class in several schools every day. The \'isits would inevitably end 
with an invitation to join the teachers and school director for a 
motivational talk o\ er tea. Teachers who used Radio Math in their 
classrooms were proud of the progress of their students and cheerfully 
boasted how their second graders now knew more math than third- 
grade children! 

On the last day of the Cochabamba pilot, the Radio Math team was 
just leaving the FyA office when a delegation of parents arrived from 
the pilot schools. Realizing that the pilot was coming to an end, they 
had been nominated by the other parents to ask that Radio Math be 
continued. After making an impassioned appeal, e\'erv member of the 
parents' delegation circled around to thank each member of the 1-yA 
team. 
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" VAV'iv riiiMi their cxpcctiition^. vVt* avi't let the pare}it> mid the 
teueher^ doie)!, and lehnt about theehildreii?" 

H. Gloria Esposito, Fy A Diroctt^r CochaKirnba 

NGOIMinistnj Collaboration: Decentralization 
at Wlork 

" ...We loere ahvinis behind theprojeet beeau^e both ehildre'ii mid 
pnreiitii liked the prosinvfi. It prodiieed results. Iteaptiired the 
i^pirit ofh'uA," 

Victor Biajot 

Encouraged by the outcome of the Radio Mathen^iatics pilot, FyA and 
EDC sought additional funds from the Government of Bolivia and 
USAlDtocompletethelRl mathematicscurriculum for lower-primary 
school, and to pilot a radio-based Spanish-language module for 
bilingual children in first grade. From the beginning, RLP's approach 
was unique because all financial, technical, and administrative 
responsibility for research and de\'elopment was managed by FyA 
rather than by the MEG. This decentralized NGO-run approach was 
critical to the success of RLP, given the decay that existed within the 
political structure at that time. 

Parents 
wanted 
to learn 
along 
with 
their 
children. 




For more than a decade, near constant turnover at the ministerial level 
weakened the credibility of Bolivia's educational authorities and 
widespread, systemic corruption polari/ed the professional teaching 
corps. The general failure of the MUG to respond to the needs of its 
constituents served U> strengthen the role of the union as the teachers' 
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adx'ocate. By 1988, thv teachers' union was the largest niost powerful 
union in the country, and a major political force. In essence, as 
teachers' loyalty shifted from the MEC to the union, it gained not onlv 
the ability to drive educational change, but also the power to influence 
the political agenda. 

In the face of the deeply-rooted suspicion between the MEC and the 
teachers' union, RLP adopted a decentralized approach to 
institutionalization, cultivating a partnership with the teachers, 
students, and parents at the local level in FyA schools. Satisfied 
teachers, in return, advocated continuation and expansion of the 
program to other teachers, to educational authorities in their union, 
and to the MEC at the Departmental level. It was not, however, until 
RLP's programs were validated and supported by both the teachers 
and the union at the regional level that the MEC and RLP could e\ en 
begin discussing national expansion. 

Starting with an NGO 

",..Fi//\ sfn'tvs not oiih/ to provide /Ys own <itiuiont<i with the /vsf 
po>^ib!c ciiiicatioih hut to scnv a fiiodcl for\^ood cducntion 
throii^^hout thccowitry." 

Gabriel Cod ina 

RLP was not designed as a MEC intervention but to test an alternative 
instructional program. Since FyA had government authority to run 
their schools in an autonomous manner, they were not obliged to seek 
MEC approval for the project, and they didn't, FyA was only 
interested in making a commitment to RLP if they had complete and 
unconditional authority over the project. After all, they had developed 
their reputation as national leader in education and were not about to 
riskitforlRI. 

From the beginning, it was clear that RLP's integrity had to be 
protected from premature alignment with either the MEC or the union 
if the program was to be successful. On one hand, deep-sealed 
cronyism and ever-changing leadership weakened the MFC's ability 
to provide long-term continuity to RLP, From 1987 to 1994, Bolivia 
had six Ministers of Education. Everytime the Minister changed, .so 
did his policy advi.sor.s, program directors, and project managers, 
Cii\ en the short time that most Ministers were in power, immediate 
impacts were prioritized o\'er long-term achievements. Meanwhile, 
the .same political tension that gave the teachers' union momentum 

15 
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alsothreatenedRLP implementation. Interventionscmbracedby one 
group were automatically targeted by opposing groups. 
Since the MEC was unable to guarantee continuity from one 
administration to the next, development of their internal capacity to 
design and manage IRI seemed daunting. This made investment in 
Fy A even more attractive. Not only could FyA use their newly 
acquired skills to enhance RLP implementation, they could become a 
resource for the MEC and provide continuing technical assistance 
during institutionalization, and throughout curricular reform. 
Development of local expertise could also alleviate the dependenceon 
expensive international consultants and improve cost-recovery. 

S4iwagiug Growth 

" .Sfrntr^ic plnufiifiK^ /s }iot conniioii hi Bolivia, /f 's nil 
thcorctiail. The rich history ofphuniifi^ arai cvaluatiivi in 
previous IRI projects filled ii^ irith funr iiicci^ about hoio loc could 
/^sr these tooh to s//r//^vjf//n/ oiirow}i xoorkafui pro}}iotc loii^-tertfi 
acceptance,./' 

EmilioOrof.Mendez 

From the beginning, RLP's expansion strategy supported the concept 
that the key to long-term success was successful management. This 
meant expanding IRI outreach at the same pace as the program's 
ability to provide services. It further supported the view of focusing 
initially on FyA schools, where the infrastructure necessary to make 
RLP a success was already in place. 

Sustained 
exposure and 
positive 
results 
generated 
demand for 
IRl on behalf 
of teachers 
and parents. 
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From 1988 to 1994, the project almost doubled in size annually. This 
growth was not, however, unplanned. FyA began field operations 
with high levels of diffusion in three urban centers. By targeting these 
areas, RLP was able to focus more on quality concerns than logistical 
obstacles; and in essence, guarantee a successful first year. At the 
same time, sustained exposure and positive results generated demand 
for IRl on behalf of those teachers and parents not being served by the 
program. Establishment of a solid internal methodology further 
enabled RLP to strategically plan their response to different sets of 
challenges like bilingualism, rural outreach, decentralized 
supervision, and teacher training. 

Curriculum Development: A Lengthy Process 

"It took us one year to create the master plan, uutli help from 
outside consultants. But the stor\/line and for mat zvas ours, and 
we created this program for Bolivian children, " 

Jaime Reyes, Director of Curriculum and 

Production, PER. 

The master plan was created by following suggested guidelines for 
interactive methodology: using segmentation, logical sequencing, and 
prior knowledge. To design the second grade program, RLP s team 
first analyzed the national Bolivian math curriculum. They then 
compared it to the IRI programs developed in Nicaragua. Given the 
positix'e results of the pilot program, RLP decided to begin with a local 
adaptation of Nicaragua's second grade lessons, in order to represent 
the classroom viewpoint, the team included input from a group of 
three certified, practicing teachers. Their strength was practical 
teaching, not theoretical material; and their participation helped 
ensure that each exercise and problem strictly adhered to the logical 
order in which the children should learn the content. 

This approach was advantageous for several reasons. First, the 
recorded pilot lessons afforded RLP a one-month margin for error. 
Second, review and revision of the original Radio Math programs gave 
RLP's curriculum team a unique opportunity to begin with a validated 
product, to use comparative testing to improve upon that product, and 
to internalize the IRI methodology throughout the adaptation process. 
Because of this, RLP was able to initiate in-school broadcasts within 
soN'cral months after project start-up; and the local staff was able to 
gain a solid understanding of the IRI methodology prior to 
undertaking the complex task of restructuring the third grade 
curriculum the following year. 
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The team 
made sure 
that each 
exercise 
adhered to 
the logical 
order in 
which 
the children 
should learn 
the content. 

In 1988, RLP worked with 10,000 second-grade students in FyA 
schools in the Departments of Cochabamba, Santa Cruz, and the Beni. 
The following year, the same cohort was used to validate the third- 
grade programs while the revised second-grade programs were made 
available to FyA schools in two additional Departments — 
Chuquisaca and Tarija. Enrollment jumped to 13,000 that year, hi 
1990, Bolivia developed and validated a complete fourth-grade 
mathematics curriculum using IRl. While the original cohort 
participated in this validation, overall enrollment doubled as FyA 
opened second-grade matriculation to all public schools in the five 
participating Departments. That effort continued into 1991 with 
dev elopment and validation of the fifth-grade mathematics program, 
as well as the design and field test of the first IRI curriculum in 
p r e\' en ti\'e health. 

The lapped year design (Table 2) was followed throughout the 
validation, dissemination, and revision of the complete mathematics 
and health curriculum. Itsemployment helped RLP control forerrors 
in programming and thus guarantee the MFC an improved product 
for institutionali/atii^n. Because of this, RLP has consistently 
produced learning gains averaging 30^^» higher than the traditionally 
taught cohort at e\ ery grade level. 
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TABLE 2: 


RLP/PARI 


DIFFUSION 


— — . 


^ — „ — 
1 — — 


Year 


n^Dflrtmpntc 




Students 


1 — ^ 

Grades 


Grades 




enrolled 


Stations 


enrolled 


diffused in 


diffused in 










FyA schools 


MEC 












schools 


1987 


2 


Cassette 


450 


Partial 2 




1988 


3 


8 


10,000 


2 




1989 


5 


10 


13,000 


2,3 




1990 


5 


18 


25,000 


2,3,4 


2 


1991 


6 


18 


70,000 


2,3,4,5 


2,3 


1992 


7 


24 


120,000 


2,3,4,5 


2,3,4 


1993 


9 


22 


180,000 


2,3,4,5 


2,3,4,5 


1 1994 


9 


24 


250,000 


2,3,4.5 


2,3,4,5 



Buildiug Partnership with the Teachers 

in Bolivia arc uot theoretical. Through RLP/PARI. I've had an 
opportunity to vi>it t'PtTi/ corner of Bolivia. Even/where / i^o / 
talk with the teachen^, listen to their perspective, ob^^erve their 
reality, breathe their air. I noiv have a broader vision about the 
i^suea con fronting^ edueatioji. I have evolved alon^ with the 
pro^^rain.." 

Betty Barron do Luna, RLI\/PARI Director of 
Evaluation and Implementation 

From the Lx^ginning, RLP has viewed teachers as its foundation for 
success, and searched for ways to transform their role from outsider to 
participant to advocate. Because of this, RLP has explored innovative 
ways to form partnership with the teachers — by responding to their 
needs, by reinforcing their role in the classroom, and bv 
acknowledging their unique contribution. In this respect, RLP's 
approach to sustainability has been one of integrating IRl within the 
existing system, rather than conditioning the svs tern to fit the 
methodolc^g)'. 

By basing the program on the reality of the teacher, RLP developed an 
effective instructional package that facilitated easy adoption of the 
methtKiology . One key element of the package was the teachers' guide. 
For piH^rly trained teachers, access to a detailed teachers' guide alerted 
them to the content of the daily lesson, and relieved them of some of 
the anxieties of preparing their own lesson plan. The teachers' guide, 
which provided both problems and answers as well as step-by-step 
instructions for resoK'ing each exercise, reinforced teachers' own 

lii 
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knowledge of core subject material. Participation in RLP carried the 
additional guarantee that all elements of the "official curriculum" 
would be presented by the end of the school year, and taught correctly. 
It ele\'ated teachers' sense of pride to see their students doing so well. 
On the other hand, better teachers could continue developing their 
own daily lesson plans for use in the post-broadcast session. These 
plans could be based on the lesson content outlined in the teachers' 
guide as well as on the teachers' professional observations. 

Responding to the Teachers 

"\ idnitificd ivith F\/A and worked to iiitc^^ratc Fi/A's coniniiiniti/- 
tcaclwrfocu:^ into the pro^rant. " 

Betty Barron de Luna 

RLP staff traveled throughout Bolivia to train participating teachers, 
observe the IRI classes, and participate in local evaluations. Every day 
of the sch(H)l year, the IRl lessons were broadcast and monitored by 
trained staff visiting participating schools. These \'isits were 
important not only because they provided feedback on the lessons, but 
because thev made the participating teachers and school principals 
feel important. For many teachers, this was the first visit that they had 
received from an education authority in years. Knowing that RLI^ 
valued their participation and sought their advice strengthened 
teachers' identification with the program. 

The observations also provided keen insight into teacher acceptance 
and implementation obstacles. In 1988, 243 FyA teachers participated 
in the validation of the second-grade IRI math curriculum in Santa 
Cruz, Cochabamba, and the Beni. At the end of the school year, 
summary meetings were held with teachers in all three Departments. 
The purpose of these meetings was for teachers to share their 
experiences using IRl with the RLP staff re\'ising the second-grade 
materials. 

Regarding the curriculum, many teachers noted surprise at children's 
ability to keep-up with the rapid pace of instruction and master 
concepts (such as teaching multiplication tables beyond five) that 
went beyond the official Bolivian syllabus. Other teachers said they 
had learned more about the pedagogy of mathematics from the 
programs. A major criticism was that the time required of the teacher 
to prepare for the radio class was too demanding. Teachers claimed 
that copying exercises onto the blackboard prior to the broadcast took 
valuable time away from other subjects. They also felt the programs 
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were too generic. Teachei s from Santa Cruz wanted to hear more of 
their style of music, and teachers from the Beni wanted characters who 
talked like themselves. 

hi every meeting, teachers asked that Radio Math be continued 
through grade five, the last year of the primary-school cycle, even at 
the cost of sacrificing the pilot language module. They argued that it 
would be a disservice for children to learn by IRI in the lower grades 
only to be "dumped" back into the mediocrity of traditional 
instruction later on. Furthermore, the teachers claimed that it would be 
a disincentive for them to have to restructure their fourth and fifth 
grade programs to pick-up where the radio left off. 

RLP listened to the teachers' concerns and addressed the issues thev 
raised. The revised edition used popular regional music, and 
integrated "radio teachers" fromdifferentpartsof thecountrv. The 
lesson format was also modified to ha\'e the radio ciictate problems 
throughout the broadcast, relieving the classroom teacherof having to 
copy the exercises beforehand. Gi\'en the significaQnce of these 
changes, teachers who participated in the first-year evaluation were 
surprised and pleased to discover the modified curriculum the 
following year. Surprised, because their suggestions frequently go 
unheeded. I^Ieased, because they were able to influence a national 
program. This knowledge further enhanced teachers' identification 
with and sense of contribution to the program. 



Perhap.s of greatest significance, however, was KLP's decision to 
respond to teachers' concerns about student preparation and to 
tacilitatcHlevelopmentofthelKI mathematics curriculum through fifth 




The teachers' 
guide 
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grade. According to Gabriel Codina, "I feel very satisfied that we were 
able to complete the math cycle when no other country had." Other 
countries like the Dominican Republic, Nicaragua, Honduras and 
Costa Rica had begun the process, but Bolivia was the only country to 
complete the radio math curriculm up to the fifth grade. 

Honoring Recommendations 

"... Motivation, follow-thnmgh, ami trniniui^ are the keys to RLP/ 
PARVs success. We continued to provide trainin;;^, even at our oivn 
cost../ 

H. Maria Otnegui 

RLP's efforts to solicit and follow-through on teachers' opinions 
created a bond between the program and the teacher that would last 
through the life of the project. That sense of partnership came in 
handy in 1989 when it was rumored that a potential change in FyA 
leadership could result in the withdrawal of institutional support to 
RLP. It was not that FyA was dissatisfied with the program but rather 
concerned about the impact that stringent USAID reporting 
requirements might have on their autonomy. 

In response to this serious situation, RLP supervisc^rs, acting on their 
own initiative, began to collect recorded testimonies from parents, 
teachers, students, and even the radio stations in defense of the 
program. The testimonies were broadcast city-wide in Cochabamba, 
where reports of a planned march in support of RLP began to 
circulate. Fortunately, the new FyA Directorate \'oted not only to 
continue with RLP but to provide IRI teachers with additional training 
support. 

Although this was the first serious challenge to IRl's ongoing 
implementation, it was not the last time that RLP's constituency came 
together to advocate the program. Not only did teacher support 
surface when challenged by the union, but time and time again as the 
MEC considered institutionalizing the program within their national 
plan. 

Enhancing and Rcxvarding Teacher Knowledge 

Partnership with the teachers was further enhanced by emphasizing 
the impc^rtance of their contribution to the radio class. Every day, 
teachers were tasked with impc^rtant actix ities that only they, and not 
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the radio, could do. For example, teachers were called upon to assess 
and respond to the learning needs of slower students. This was 
revolutionary because it challenged the traditional practice of tailoring 
instruction to the fast learner while overlooking the special needs of 
the slower student. Teachers were also charged with monitoring their 
students during problem-solving activities so that they could reinforce 
deficient skills in the post-broadcast session. This, too, was 
innovati\'e because it prompted teachers to be needs-driven rather 
than routine and impersonal. By facilitating interaction with the radio 
and by leading students through exploratory activities, the teacher 
was transformed from classroom lecturer to learning facilitator. Such 
direct invoK'ement served to reinforce teachers' sense of partnership 
with the program and the methodology. 

The Teachers' Guide 

RLP also provided incentiws for teacher follow-through. Ownership 
of the teachers' guide was one such incentiv e. The form and content of 
the teachers' guide changed as the program was implemented. 

"I'lh'^uiiic iniprovcti tine to the teacher:^' owti int^^^cstiojin. After 
(ill, tluy n<cii the pn\^nittiiicvcnfiia\f in their tia<^roonj:i...It took 
niorc thivi fiir \/car^ for the ^uitie to evolve. " 
Jaime Keves 

On completion of the school-year, the guide passed from RLP to the 
teacher. Because teachers were not given instructional materials bv 
the state, they valued having access to a detailed instructional 
program that they could use independently of, or in conjunction with, 
the radio. 

Teacher Training 

T raining in the methodology was another incentive however, not all 
training strategies were successful. A series of strategies were tried 
over the course of the project. The first few \'ears, a small group c^f 
people traveled around providing training. As the program grew, four 
or five people were not enough to reach teachers in all of Bolivia. So 
KLPhad toft^rm multiple teams, each of them responsible forse\'eraI 
Departments in the country. These teams would travel extensively for 
a month at the beginning of the school year however, the demand was 
such that they were not always able to train all participants by the first 
week oi classes. 

'C6 
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An example of a training approach that never really took off was the 
attempt to convert MEC supervisors into training multipliers. 
According to EmilioOros, 

"When we had to train siipcrviors ami adminstratorsfrom the 
Mifiistrif of Education so that they would pass on what they had 
learned, we had training sessions and the supervisors did learji. But 
zee never really thought that they hi turn taught the teachers. Wfe 
had to do twice the zvork to retrain teachers zoho needed oiir support. " 

From a technical standpoint, the teachers can learn to use the 
methodology in only one day. But they also need to understand the 
learning theory, and this takes more time. By agreement with the 
Ministry of Education, the training was completed in two mornings or 
afternoons. First there was an introduction to the methodology, 
followed by a review of basic skills and content, then an explanation of 
the teachers' role in the program, and finally a model class with 
children. An important part that took up almost the whole second 
morning was training in how to use the teachers' guide. 

Although RLP restricted formal participation to trained teachers, the 
one-day training was free of charge. This practice diverged from 
traditional training where the teacher would have to pay to attend a 
training seminar. Once RLP became institutionalized, the MEC went 
on to grant leave with pay for teachers in training. Perhaps best of all, 
teachers who attended the initial IRI training, used IRI regularly in 
their classroom, and kept a post-broadcast log were rewarded with a 
certificate of merit at the end of the school year. School directors who 
regularly reviewed their teachers' logs were also certified. When 
RLP/ PARI became recognized as Bolivia's official mathematics 
program in 1992, the MEC valued all certificates with five points 
towards teachers' promotions and pay raises. 

Teachers as Advocates 

Satisfied teachers became powerful advocates of RLP. Not only did 
they encourage other teachers to join the program, they made personal 
sacrifices to continue their own participation. Some teachers valued 
participation so much that they brought their own radios to school or 
paid for batteries out of their salary. Others came to school during 
their day off — just for Radio Math. Parents took note of teachers' 
initiatives and began to provide support in small ways. Where they 
could, parents pooled money to buy the school a radio or pay for its 
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maintenance. Others paid for teachers' transportation to continue 
Radio Math during off days. 

Because many people heard the radio program word of its impact 
spread quickly. Sometimes, the parents of children not participating in 
IRI made their schools accountable for joining the program the 
following year. More frequently, teachers who were not using the 
methodology noticed such a positive change in the attitude and 
effectiveness of their colleagues using IRI that they requested 
permission to enter the next year. School directors were another 
vehicle for passing the word, especially when the principal had led an 
IRI class herself. 

Instructional Design: Catering Learning to the 
Learner 

"..Jlw IRl technique was a novelty. )AJe xvere versed in usiiii^ 
vndio with adults^ hut usitii^ it for children was neie. From the 
first day we noted that IRI released aii avaUniclie of emotions in 
the students: and the teachers icere impressed by the quality, " 
Jaime Reyes 

Not only has IRI dramatically changed the way that teachers teach, it 
has also changed the way that children learn in Bolivia's schools. 
When RLP was designed, teaching practices were not conducive to 
student learning. There were no textbooks in the schools, the teaching 
method of choice was whole-class instruction, and little positive 
feedback was provided. Many teachers were either not prepared, ill 
prepared, or too uncertain of the material themselves to provide a solid 
foundation. As a result, instruction in core subjects was inadequate 
and related student repetition and drop-out was high. 

Breaking with tradition, 1 Rl places the student at the center the 
learning process by eliciting active student participation. It provides 
ample opportunity to apply and practice what is being learned. At the 
same time, it provides constant feedback to its user by modeling 
problem -solving skills and reinforcing correct answers. By 
challenging children to become active learners, IRI awakens their 
desire to participate in and contribute to their own education. This 
section discusses how IRl has contributed to improving education in 
Bolivia's schools. 
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Making Instruction Effective 

One of the reasons that IRI has been used so successfully in Bolivia is 
because of its instructional design. IRI programs are effective and 
entertaining. They sequence the introduction of new learning 
concepts, engage students in problem-solving, and lead students to 
subject mastery through inductive and participatory activities. 



By 

challenging 
children to 
become active 
learners^ IRI 
has awakened 
their desire to 
participate in 
their own 
education. 



IRI lessons follow a logical sequence. They present and explain new 
material while reviewing concepts already taught. To begin, a 
comprehensive master plan is mapped out by content experts using 
the official curriculum as its basis, and daily lessons are outlined. Tht 
resulting IRI program has five or six brief learning segments; apart, 
each segment is a miniature module carrying students one step closer 
to mastery of specific learning objectives. Woven together, they 
become a'carefuUy crafted blend of new skills and reinforcement 
practice in support of common instructional goals. 

Wt' lanHCil (/s w wait nhvi^. Coutimiini^fornmtivc rcsciurh 
xra^ crifical /// providiii^f //s with iuiportant ///s/\>//f into the im/ 
that tcnchcrs mid i^tiuintts perceived IRi U enaMed t/s to tailor tlie 
curriciduiu and methodoh;;^}/ to their ueedt^. " 

Hmilio OrosMende/ 



A strategy for evaluating lesson effectiveness was also built into the 
master plan. Rather than wait until the end of the school year to test 
the instructional integrity of the programs, IRI used continuous 
formative evaluation to fine-tune the curriculum as it was being 
developed. This research tailored the instruction to the learning 
needs and interests of its users. Qualitative observations of student 
interaction during the IRI class were recorded on a daily basis. Short 
bi-weekly tests werealsoadministered tomeasure student knowledge 
of concepts to be introduced over the next two weeks, to assess student 
comprehension of concepts taught over the past two weeks, and to 
ev aluate children's retention of messages presented in the preceding 
month. This feedback was used to formulate future lessons and to 
roviseexisting programs. 

Encouragiug Active Student Participation 

IRI keeps students interested by making learning enjoyable. The radio 
lessons enliven the classroom atmosphere through the imaginative 
use of stories, songs, physical activities, and role plays which invite 
the active participation of the student in the learning process. 
Although children respond to questions and activities posed by the 
"radio teachers" every 20 seconds on the average, the nature of that 
interaction is the product of creative scripting. Today, more than 600 
Radio Math and Radio Health lessons have been validated in Bolivia. 
They all combine entertainment with education. Such lively 
participation is central to the effectiv eness of both the medium and the 
methodology. 

Making Learning Relevant 

IRI stimulates learning by presenting familiar situations which enable 
students to apply what they have learned. It draws heavily on the 
student's reality to explore basic mathematical concepts. All examples 
used during the radio lesson mirror the child's environment. 
Decisions which Boliv ian children confront everyday, like buying a 
snack during recess, playing soccer after school, or sharing a piece of 
fruit, are modeled into exercises that teach the basics of subtraction, 
division, and fractions. 

Given the sensitivity of reaching a socially, culturally, and 
geographically diverseaudirnce, first-hand knowledgeof the 
C(^ntextual reality of the students was researched throughout the 
cou ^e of ^he project. Travel to participating communities allowed 



27 



Bolivia's Partners in Innomtion ♦ 



RLP staff to visit neighborhood schools, observe classes, and gather 
information about students' understanding of mathematics. The staff 
participated in recreational activities such as playing games and 
drawing pictures to learn more about students' interests, motivations, 
and interpretation of specific words and images. They also obser\'ed 
children in their home and community environments. Given the high 
degree of convergence found across regions at the school level, and the 
many differences found at the community level, RLP staged the school 
as the central unit of activity in each IRI program. This ensured both 
recognition and relevance for the target audience — children in school. 

Making It Rewarding 

KLV's programs were designed especially for children. Because they 
were more acti\'ely invok ed, students learned more; and because the 
programswerestructured,entertaining, and relevant, more students 
could keep-up with the instruction, apply what they were learning, 
and do better overall. Improved performance not only enhanced 
students' self-esteem, it also reinforced teachers' sense of contribution. 
Parents, too, were encouraged by these positi\^e results and supportive 
of the intervention. Satisfied users became RLP's most convincing 
advocates. Every year the program expanded as more parents and 
teachers took stock of IRI's impact. In this manner, RLP/PARI grew to 
serve more than 600,000 primary -school students over the course of its 
implementation. 

Institutionalization and Neiu NGOs: Adapting 
to Change 

liiui the appeal ofcomiuctiiii^ quality experimental 
pro^ram^. \Ne have a reputation for i^crioui^nesi^, control, and 
rei^poni^ibiliti/. Therecaniea time, however, luhcn F\/A's 
contributiou wa^^ complete, when the future of the pro\^ram mn^ 
bci^t addrci^scd ehewhere,,/' 

Gabriel Codina 

FyA perceived RLP's greatest contribution not as being "the solution" 
to Boli\'ia's education woes, but as being the most cost-effective, 
immediate, and manageable option for improved learning while the 
Ministry went about the business of upgrading the teaching corps. 
Since in^proved teacher quality was viewed as a generational 
undertaking, RLP had to become more than just another "four-year 
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experiment." It had to respond to the long-term needs of both its users 
(the teachers) and its beneficiaries (the students). 

Although Fy A had made a commitment to shepherd RLP into their 
own schools, they had never intended to become a vehicle for national 
implementation. In spite of this, overwhelming demand for IRl by 
underserved public schools compelled FyA to place access to IRHn the 
public domain in 1990. Enrollment doubled that year, tripled again in 
1991, and gave all indication of continued expansion in following 
years. Clearly the potential for RLP in Bolivia had grown beyond even 
FyA's or the MFC's wildest dreams. 

".,./// tlichc^i}iniii\;iJ'}n luiccrtabi that thcMEC rcalhj 
understood the potential of PARI. Mi/ first visit to Cobijn to 
evaluate the program urns not impressive. It zoas not until I he^^^an 
to visit the schools and see the impact of the mathematics pro^^ram 
on the studeiits and the teachers that I came to reaUzc its 
importance. When tliousands of teachers throughout the coimtry 
tell me that thepro^^ram is valuable to them, there must be 
so))iethini^ to it,.." 

Prof. Jorge Ayala 

Since FyA had neither the resources nor the mandate to supervise 
public schools outside of their own network, they made a conscious 
decision to pass RLP management to the MFC in 1991 . By that time, 
RLP's technical, implementation, and supervisory systems were all in 
place, and the IRI curriculum was fully validated. Realizing that FyA 
leadership of RLP would soon be ending, and that their role would be 
severely reduced, the core technical group of FyA employees who had 
managed RLP from its inception and guided its growth as a project 
established their own NGO, Programa de Educacion por Radio, to 
facilitate successful MFC transition and to leverage union support. 

Because they 
were more 
actively 
involved^ 
students 
learned more. 
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Founding Programa de Educacion por Radio 

"...Mosf Bolivians work for salary, }jot for enterprise. We came 
into Radio Math havini^ worked together as a team: however it 
was not until RLP moved into an office outside of Fx/A 
headquarters that xoe gained antonomif. We began to make 
decisions that we wonld not otherwise have had to. Our team 
evolved along xvith RLP; although loe remained loyal to FyA, our 
identity loas increasingly tied to the project, Wheii the time came 
to transfer the program from FyA to MEC management, we 
founded PER, We had grown together so nnich, we couldn't risk 
loshigthat continued senseof contribution a}idgrowth„,that 
affinity. Even though xue were anxious and at times ambivalent, 
our dec is io mva s obvio us,,," 

EmilioOros Mendez 

Tremendous project growth in 1988 required more administrati\'e 
oversight than FyA had anticipated, prompting the project staff to 
mo\'e from FyA headquarters into its own office and hire its own full- 
time staff. Once they began operating in an autonomous fashion, the 
identity of core staff became even more strongly aligned with the 
project as they matured professionally and as a team. 

IRI draws 
heavily on 
the student's 
reality to 
explore 
basic 

mathematical 
concepts. 

By 19^1, more public schools were participating in RLP than were 
FyA counterparts. Since full responsibility for training and 
supervising non-Fy A schools fell on RLP's staff, their credibility as 
education authorities grew independentlvof FvA. When FvA first 
propc^sed transfer of project nianagement t(^ the MFC, three* related 
issues became ev i d en t : 
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❖ Public-sector cooidination meant dissolving the core 
group of FyA managers and technicians that gave 
RLPits vitality; 

❖ The MEC still lacked the managerial and technical 
capability to pick-up where FyA left off; and 

❖ RLP's project team realized that their professional 
commitment to institutionalizing RLPoutweighed 
their personal concerns about being reabsorbed into 
FyA. 

PER's organization in 1991 gave definition to a five-year transitional 
management plan for RLP, establishing both policy and precedent: 
policy, because IRI was the first national education intervention 
adopted by the MEC prior to formalizing the national education 
reform; precedent, because of PER's bold decision to place their 
prestige on the line and organize union support for MEC 
implementation. 



IRI has 
provided 
us zvith an 
outlook on 
what ive 
must do to 
reach our 
goals.' 




Under I'ARI, Ihu MEC was responsible for national supervision of the 
IRI program and forsupporting recurring costs within the education 
reform. PER was accountable for training MEC personnel applying 
thelRI technology in program development, implementation, and 
management. FyA was responsible for training and supervising their 
own network of participating teachers; and EDC was charged with 
ensuring smooth collaboration among these institutions. Impact from 
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this concerted effort paid off quickly, and word of the successful 
collaboration spread. In 1992, more students participated in PARI 
than the total of all previous years. In 1993, IRl expanded to all nine 
Bolivian Departments, and by 1994, MEC supervisors and union 
representatives articulated unanimous support for PARI by ratifying a 
joint resolution in public ceremony. 

In 1993, the last completed school year for which data are available, 
hiteractive Radio Learning reached several milestones in its 
development. 



i QUANTITATIVE 


PLANNED 


ACHIEVED^ 


Radio math usage in all 9 
departments 


Q Hntnc 


Q Hntos 


Radio health curriculum validated in 
20 schools in 3 departments 


3 dptos 
20 schls 


4 dptos 
200 schls 


National infrastructure of trained 
teachers, school directors, and 
supervisors 


7,500 
Trained 


8,000 
Trained 


Math students (cumulative) 


150,000 


350,000 


Health students (cumulative) 


50,000 


60,000 


Teachers quides - math 


4 grades 


4 grades 


Teachers quides - health 


3 grades 


2 grades 


Math lessons produced/revised 


540 


540 


Health lessons developed 
cholera pilot - 1992 
grade 3- 1993 
grade 4- 1993 
grades - 1994 
stories for school break 
bilinqual pilot - 1994 


10 
30 
30 
30 
20 
10 


10 
30 
30 

11 


Bolivian technicians trained 


20 


40 


Promotional video tapes 


5 


2 1 



Final Thoughts 

Clearly, the dedication of RLIVPARl's seasoned staff and its focus on 
popular participation has facilitated IRl's "institutionalization" 
within the MEC; however, nurturing PARI within that everchanging 
structure presents the biggest challenge to its sustainability. For the 
past three years Bolivia has embarked on the design of a 
comprehensive educational reform package that will define all future 
investment in the sector. Continued support for PARI's 
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implementation within the reform is critical, at least until the MEC is 
able to strengthen their teaching corps and extend equitable, high- 
quality instruction in its schools. As Jorge Ayala explains, 

"..JRl was never meant to be the solution. Nevertheless, it has 
helped us;;^et across a sense of reasomng, planning Jormation, It 
has opened our horizons. It has provided iis with an outlook on 
life, on how we live, on what we must do to reach our goals. Until 
zoe are able to put something more effective, more encompassing in 
its place, my responsibility is to see that IRI continues. " 

Sometimes the key to the future is more suitably found in the past 
Father Victor Blajot encourages PARI to be faithful to the ideals with 
which it began, 

"As we look to decentralization, parents and other community 
members will be "reenfranchised" in the education si/stem and 
provide continuing oversight at the community level. Decisions 
affecting teacher selection and curricular concerns will be 
community driven. Education will become more responsive to 
community needs. RLP/PARI is a serious project. Schools embrace 
it because it helps the teachers to be more effective. Parents like it 
because their children are excited about learning. Students like it 
because they are actively involved. This is, after all, what 
education is all about... " 
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ANNEX A: Chronology of Events 



Radio Learning Project: 1986 - 1991. 
1986 

❖ Comision Episcopal de Educacion (CEE) reviews the state 
of Bolivian primary education and recommends that 
mathematics be improved at all levels. Interactive radio is 
identified as a potential intervention to address this need. 

❖ At the invitation of USAID/B, EDC conducts a feasibility 
study to assess the potential of using IRI in Bolivian public 

❖ FyA and EDC receive an USAID/B grant to pilot the use of 
interactive radio over a three-month period . 

1987 

❖ Training of FyA staff participating in second-grade pilot. 

❖ Pilot implemented in FyA schools. Radio intervention 
significantly increases children's understanding (64% pretest, 
90"^» posttest) of basic concepts taught. 

❖ FyA and EDC collaborate on the design of Radio Learning 
Project. 

❖ Pretest second-grade control group to establish baseline for 
future curriculum development activities. 

1988 

❖ FyA and EDC contract with PL 480 and USAID/B to provide 
local and international technical services under RLP. The 
objectives of the project include: (1) develop and validate a 
comprehensive interactive-radio mathematics curriculum for 
lower-primary school; and (2) pilot a first-grade radio-based 
Spanish-language program. 
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RLP develops 130 half-hour interactive-radio lessons for daily 
transmission of second grade mathematics. The series is 
validated in the Departments of Santa Cruz, Cochabamba, 
and the Beni. Summative evaluation supports the impact of 
the radio intervention. (Posttest mean scores: 46% control, 
66% experimental.). 

Teachers request that RLP continue Radio Math through the 
last year of primary school, fifth grade— even at the cost of 
sacrificing language to do so. AID modifies RLP's SOW. 



1989 

<♦ 2nd grade math series is revised using formative and 

summative evaluation results. New version is broadcast. 

<♦ 130 3rd grade Radio Math programs produced and validated 
using lapped-year design. In addition, cohorts from the Santa 
Cruz and Cochabamba regions were selected for inclusion in 
a four-year tracer study. Experimental cohort continues to 
outscore the control group by nearly a half. (Grade 3 year-end 
mean scores: 37% control, 55%y experimental.) Sucre and 
Tarija join RLP bringing the total number of participating 
Departments to five. 

❖ In response to teachers' requests, a three month pilot is 
undertaken to test the potential of teaching set-theory by 
interactive-radio. Summative results do not substantiate 
significant learning gains in students. RLP stands by original 
decision to include modern math as a teacher-led post- 
broadcast activity rather than as a "radio" subject. 

<♦ Six month pilot initiated to test the feasibility of applying 
interactive-radio to the teaching of preventive-health care. 
Funding for this activity was received through a separate 
USAID/B grant. Summative evaluation indicates highly 
significant levels of student comprehension as well as implied 
practice. This pilot io the first effort to teach health by radio 
anywhere in the world. The results were published in an 
international journal. 
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1990 

❖ 3rd grade math series revised using formative and summative 
evaluation data. The revised series is broadcast in all 
participating Departments. 

❖ The 4th grade series, consisting of 135 lessons, is validated 
using year-long formative, summative, and longitudinal 
methodologies. Results produce outstanding gains. 
Experimental cohort's scores nearly double those of children 
taught by traditional methods. This is the first successful 
effort of any country to teach upper-primary school 
mathematicsby interactive radio.- 

❖ The Ministry of Education and Culture signs a Memorandum 
of Understanding with RLP to broadcast the 2nd, 3rd, and 4th 
grade programs in six Departments, including Pando. The 
MEC conducts a separate assessment of their own 
institutional capability to integrate and supervise interactive 
radio as part of the official Bolivian curriculum. 

❖ An external cost-effectiveness study of RLP concludes that the 
annual recurrent cost of using interactive-radio is just $0.81 
per student, and the incremental gain in learning equal to 1 

1 /2 times that of traditional instruction. 

1991 

*> Bolivia becomes the first country in the world to develop a 
fifth 'grade mathematicscurriculum using interactive radio. 

❖ The complete series of 135 lessons is validated through a 
regimen of bi-weekly testing and through summative and 
formative measures. Summative evaluation data indicate that 
radio students have greater dominion of basic mathematics 
principles than non-radio students. (Standardized posttest 
mean scores: 40% control, 55"/(> experimental). In addition, 
the project demonstrated that children who had the benefit of 
all four years of radio instruction have an even greater 
advantage in mathematics than children who have three 
years or less (7\%), 
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❖ Formative and summati ve evaluation results used to revise 
the 4th grade math series. The revised programs are broadcast 
in six Departments along with the updated 2nd and 3rd grade 
curricula, and the new fifth-grade programs. 

Interactive Radio Learning: 1992 ~ 1996. 

1992 

❖ USAID, EDC the MEC, and the Ministry of Health (MOH) 
sign a bilateral agreement to implement Interactive Radio 
Learning (IRL). The objectives of this landmark initiative are 
to: (1) integrate Radio Math into the Bolivian curriculum, and 
extend its diffusion to all 9 Bolivian Departments; (2) develop 
and pilot a complete "Radio Health" curriculum for children 
in grades 3 - 5; and (3) strengthen the MEC's ability to 
manage continued implementation of IRL upon termination of 
USAID/Bfunding. 

❖ MEC assumes national supervision of IRL and passes a 
Ministerial Resolution declaring interactive radio the official 
mathematics program" of Bolivia. 

❖ La Paz becomes the 7th Department to join IRL. All four 
grades of validated mathematics curriculum is broadcast. 

*> A KAP sur\'ey is conducted to establish a baseline for Radio 
Health curriculum development. A pilot module on cholera is 
broadcast and evaluated in the Departments of La Paz, 
Cochabamba, and Santa Cruz. Results of the evaluation 
confirm the power of using interactive radio to teach basic 
health concepts and to moti\'ate behavior change. 

7993 

❖ The complete mathematics curriculum is disseminated 
throughout all 9 Departments in Bolivia. 



37 



Bolivia's Partners in Innovation ♦ 39 



❖ The complete 3rd and 4th grade Radio Health series is 
produced and validated. Demand for Radio Health is tenfold 
more than anticipated! 

❖ An international congress promoting Bolivia's pioneering 
efforts in mathematics and health was held in Santa Cruz, 
October 1993. 

1994-1996 

❖ MEC assumes full implementation responsibility for IRL. 
Project to be integrated into the National Education Reform 
Act. 
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ANNEXE: Endnotes 



' Technical assistance fo rthe pilot was provided through 

Education Developnaent Center (EDC), a Boston based NGO, 
and funding was contributed by the United States Agency for 
International Developnaent's overseas Mission in Bolivia 
(USAID/B). 

- IriateG: Analisis de la Realidad Boliviana: Aspectos Socialesr 
SENPAS, La Paz, Bolivia, 1985. 

' The World Bank: Trends in Developing Economies 1989, The 
World Bank, Washington, D.C., 1989. 

^ Centre Boliviano de Invetigacion y Accion Educati\'as: La 

DesercionEscolar del CicloBasico en Bolivia. Serie: Estudios 
Educativos No. 26. CEBIAE, La Paz, Bolivia, 1987. 

' This report gathers the evidence on the direct and indirect positive 
effects of IRI on educational efficiency including improved 
student learning and enhanced teacher effectiveness. 
Nevertheless, while a solid body of research clearly 
demonstrates that mastery of literacy, numeracy, 
communication, and information processing skills prepares 
students and teachers to be more productive in the formal and 
informal work force as well as at home, the interplay of social 
and economic outcomes frequently finishes a distant second 
to the inevitable, "how much will it cost?". A 1990 study 
conducted by economist Dean T. Jamison calculated the 
de\'elopmental cost of Bolivia's Radio Mathematics program 
to be $1.28 per student (spread over 300,000 participating 
students), with an annual incremental cost of daily 
implementation, including hardware, of $.81 per student. To 
put this in perspective, it is worthwhile mentioning that the 
average cost of traditional mathematics instruction was 
$13.00 per student per year at the time of Jamison's study; and 
that the additional money spent on interactive radio yielded 
an impressive 50% increment in student learning! In 
otherwords, according to Jamison's study, IRI's "efficiency 
ratio" of incremental effectiveness (.9 effect size) to 
incremental cost was even more attractive than that typically 
found by providing textbooks or training teachers. 

' ESTIMATE,SUBJECTTOMODIFICAnON. 

' Fryer M: Bolivia Mathematics Pilot. Radio Learning Project 

Report, Education DevelopmentCenter, Newton, MA. 1987. 
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FryerM: First Year Summative Evaluation: Second Grade Math- 
ematics, Bolivia 1987-1988. Radio Laming Project Mono- 
graph. Washington, D.C.: Agency for International Develop- 
ment. 1989. 

Jamison, DT, Fryer M, Barron de Luna B, Oros Mendez, E: El 
Proyecto de Educacion por Radio en Bolivia: Evaluacion de 
Costo-Efectividad. Radio Learning Project Monograph. 
Washington, D.C.: Agency for International Development. 
1990. 

FryerM: Health Education through Interactive Radio: A Child-to- 
Child Project in Bolivia. Health Education Quarterly. Vol 
18(1), Spring 1991. New York: John Wiley & Sons. 
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